Adaptive Private Distributed Matrix Multiplication
نویسندگان
چکیده
We consider the problem of designing codes with flexible rate (referred to as rateless codes), for private distributed matrix-matrix multiplication. A master server owns two matrices $\mathbf {A}$ and {B}$ hires worker nodes help computing their The should remain information-theoretically from workers. Codes fixed require assign tasks workers then wait a predetermined number finish assigned tasks. size tasks, hence scheme, depends on that waits for. design rateless multiplication called RPM3. In contrast fixed-rate schemes, our scheme fixes allows send multiple keeps sending receiving results until it can decode multiplication; rendering adaptive heterogeneous environments. Despite resulting in smaller than known straggler-tolerant RPM3 provides mean waiting time by leveraging heterogeneity is studied under different models workers’ service time. provide upper lower bounds both models. addition, we worker-dependent model.
منابع مشابه
HP-DAEMON: High Performance Distributed Adaptive Energy-efficient Matrix-multiplicatiON
The demands of improving energy efficiency for high performance scientific applications arise crucially nowadays. Software-controlled hardware solutions directed by Dynamic Voltage and Frequency Scaling (DVFS) have shown their effectiveness extensively. Although DVFS is beneficial to green computing, introducing DVFS itself can incur non-negligible overhead, if there exist a large number of fre...
متن کاملAdaptive Matrix Multiplication in Heterogeneous Environments
In this paper, an adaptive matrix multiplication algorithm for dynamic heterogeneous environments is developed and evaluated. Unlike the state-of-the-art approaches, where load balancing is achieved through unequal distribution of the matrix data among the heterogeneous nodes, the matrices in our approach are partitioned into blocks of equal size. Task allocation and the block size are adapted ...
متن کاملPrivate Multi-party Matrix Multiplication and Trust Computations
This paper deals with distributed matrix multiplication. Each player owns only one row of both matrices and wishes to learn about one distinct row of the product matrix, without revealing its input to the other players. We first improve on a weighted average protocol, in order to securely compute a dot-product with a quadratic volume of communications and linear number of rounds. We also propos...
متن کاملSparse matrix multiplication: The distributed block-compressed sparse row library
Efficient parallel multiplication of sparse matrices is key to enabling many large-scale calculations. This article presents the DBCSR (Distributed Block Compressed Sparse Row) library for scalable sparse matrix-matrix multiplication and its use in the CP2K program for linear-scaling quantum-chemical calculations. The library combines several approaches to implement sparse matrix multiplication...
متن کاملCommunication lower bounds for distributed-memory matrix multiplication
We present lower bounds on the amount of communication that matrixmultiplication algorithms must perform on a distributed-memory parallel computer. We denote the number of processors by P and the dimension of square matrices by n. We show that the most widely-used class of algorithms, the so-called 2-dimensional (2D) algorithms, are optimal, in the sense that in any algorithm that uses only O(n...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 2022
ISSN: ['0018-9448', '1557-9654']
DOI: https://doi.org/10.1109/tit.2022.3143199